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Generalization of Gibbs Entropy and Thermodynamic Relation 

Jun Chul Parle 
Department of Physics, KAIST, Daejeon 305-701, Korea 

Abstract 

In this paper, we extend the Gibbs's approach of quasi-equihbrium thermodynamic process, 
and show that, in general non-equilibrium thermodynamic process, the microscopic expression of 



where p(x, t) is the ensemble distribution in phase space and (pAtix, x' , t) is the probability density 



Tlj- ■ entropy is given as 

S{t) = — I dxp{x,t)ln I dx' p{x' ,t)(f)/\t{x,x' ,t), 

O 

t^ \ to obtain that, in macroscopic observation, the system with initial value x' in phase space at time 

C^ ■ t is found at state x after time collapse -^ , and At is the maximum value of the time interval 

for which any macroscopic thermodynamic variables increase linearly. Also, we analyze the formal 
structure of thermodynamic relation in non-equilibrium thermodynamic process. 
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Since Gibbs had found the microscopic expression of entropy in the course of analyzing 



QE 



the quasi-equihbrium thermodynamic process [1|, |2|], there have been much effort to formu- 
late the generalized theory for entropy to be applicable in non-equilibrium thermodynamic 
process. Although recent progress related with the fluctuation theorem gives some informa- 
tion necessary to obtain such generalization |3|-l6| , it seems still far from obtaining adequate 
foundation for the general theory of entropy, in that we have not yet gained a clear con- 
nection between entropy and microdynamics in non-equilibrium process. The purpose of 
this paper is to develop a consistent theory to connect entropy and the classical dynam- 
ics in general non-equilibrium process. Especially, it shall be shown that the developed 
theory overcomes the conventional problem as the Gibbs entropy cannot discriminates the 
irreversible variation of a closed Hamiltonian dynamical system as it is an invariant for 
such system (by Liouville's theorem), which is important in constructing systematic the- 
ory of arbitrary non-equilibrium thermodynamic process in future. In this work, we obtain 
the microscopic expression of entropy in general non-equilibrium thermodynamic process, 
and prove the entropy theorem for an arbitrary closed (ergodic and chaotic) Hamiltonian 
dynamical system. Also, we will obtain the extended thermodynamic relation for general 
thermodynamic process and derive the fluctuation theorem. 

I. COMPLEX DYNAMICAL SYSTEM INTERACTING WITH EXTERNAL EN- 
VIRONMENT 

Let us consider the Hamiltonian system 

jr = H{q,p) + ViUq,7v), (1) 

where the Hamiltonian system H defined by the coordinates q = {qi,q2, ■ ■ ■ ,qN) and mo- 
mentum p = {pi,p2, ■ ■ ■ iPn) interacts with its environment system, which is described by 
the coordinate tt = (tti, 7r2, . . . , tt^), by the interaction potential Vintl?, tt). If there is macro- 
scopic slow motion of vr denoted by the time series a{t) = (ai(t), a2(t), . . . , a,,{t)), we define 
new variable as tt^ = ttj — ai{t). In macroscopic point of view, the interaction by aj(t) is 
still interpreted as a mechanical interaction; on the contrary, the interaction by vr^' is the 
quantity interpreted as thermal interaction. Instead of using the variables tt^', we replace the 
dynamical dependence of tt^' by the dependence of time t, as treat vr^' as a fast fluctuating 



time series, and Hainiltonian is written as 

^ = //(x) + Mnt(g,a,t), (2) 

where x = {xi,X2, ■ ■ ■ , X2n) = {(li, ■ ■ ■ An^Pit ■ ■ ,Pn) = {q,p)- Then, the probabihty density 
function (PDF) p{x, t) describing the ensemble distribution in the phase space F defined by 
X satisfies the Liouville's equation: 

— — — = -iL[x, a, t)p{x, t), (3) 

where iL{x, a, t) = ^^ ^'W 'Ylk W^W~^ ^^'-^' ^^ ^^^ normahzation condition for p{x, t), 

/p(MM.^l, (4) 

where dx = dxidx2 • • ■ dx2N- 

Let the characteristic time interval for our macroscopic measurement system be At in 
the sense that the error ^q of macroscopic time-measurement is given within the error range 

-^<eo<^ (5) 

approximately. In such case, the experimentally discriminable minimum of time collapse 
from a given instant is -j- in statistical sense. Then, the time series ai{t) can be interpreted 
as a time-averaged behavior of iiiit) during the error range At such as ^ f^ 7Ti{t')dt', and 
we reasonably request that, if there is increment Aa = {Aai, Aa2, ■ ■ ■ , Aa^) in a during At, 
Atti is a linear function of At: 

Aai oc At. (6) 

Generally, since arbitrary macroscopic slow variation in system J^ can be interpreted as 
such a time-averaged behavior of some complex dynamical variation during At, At is the 
maximum time interval during which we can approximate any macroscopic thermodynamic 
variable varies linearly for time. 

On the other hand, based on the dynamic complexity of system ^, for the experimentally 
discriminable minimum time collapse ^, we have the following presupposition: since we 
assume that, including the case where the system is completely isolated from the external 
variation as ttj = const, there are always some fast chaotic and ergodic motions such that 
their trajectory vary non- linearly during ^, we have 

fe-'ft ^L(-'-)^- ^l-tL{x,a,t)=^, (7) 



where L{x,t) = L{x,a{T),T) and T denotes the time-ordering operator which interchanges 
the operators to follow in chronological order from right to left; if the system is completely 
isolated, it is written as e~*-^(^'")~ 7^ 1 — iL{x,a)^. 

Similarly, if the characteristic interval of x for the given macroscopic measurement sys- 
tem is Ax = {Axi, Ax2, . . . , Ax2n) in the sense that the error ^ = (^1, ^2, • • • , C2n) of the 
macroscopic measurement for x = {xi, X2, ■ ■ ■ , X2n) satisfies the error range 

<^i< (8) 

2 2 ^ ^ 

approximately, we assume that, including the case of the completely isolated system, there 
are always some complex (chaotic and ergodic) motions macroscopically undescribable as 
a smooth path in the sense that, by these complex motions, the velocity field in F or the 
Liouville operator L{x, a, t) cannot be approximated linearly for the increment -^ in x; thus 
we have 

L(x. + ^, a, t) 5^ L{x, a, t) + ^_B^^^, (9) 

In the followings, we will trace the rational consequence of the presupposition ([5]), (E]), 
(ED, (ED, and (ED- 

II. MACROSCOPIC BEHAVIOR OF ENSEMBLE DISTRIBUTION 

For the macroscopic system characterizing such value At and Ax, the experimentally 
observed quantity for p{x, t) is given by p(a;, t) as 

1 ft+^t c^+Ax 



p(^,i) = ^^^y y dt'dx'p{x',t'), (10) 

where AF is the volume of Ax; or more precisely 

/OO /"OO 

/ d^od^fi^,^o)pix + ^,t + ^o), (11) 

-00 J —00 

where /((^, ^q) is the PDF to obtain the errors ^ and ^q. The slow varying property of p{x, t) 
can be expressed as 

p{x, t + At)^ p{x, t) + ^^^' ^' At, (12a) 

p{xi + Ax„ t) ^ p{x, t) + -^^^Axi, (12b) 

OXi 



and, by the normalization condition for p(x, t), 

p{x,t)dx = 1. (13) 

The slow varying property of p{x,t) means that, for a given thermodynamic process, 
p{x, t) is expressible by a smaller set of independent physical observables e = (ei, e2, . . . , e,^) 
than x, where e^ is defined by x and a, i.e., e = e(x,a); for example, the energy H{x) + 
Mnt(Q',fl) in dl]) can be one of the such observables.^ Although the number and kind of 
the observables e^ alters depending on the concerned thermodynamic process, we expect 
generally ^ ^ A^ for the conventional thermodynamic system with Avogadro's number of 
degrees of freedom. Finally, more specifically, we write the expression of p{x,t) as 

p{x,t) = p{e{x,a),t); (14) 

in abbreviation, we will use the notation p{e{x, a),t) = p{e,t)? Corresponding to the vari- 
ation of the external parameter a, the statistical properties of each dynamical variables e^ 
are expected to vary slowly. Thus, we assume that we can control the statistical properties 
of ei with appropriate time series a{t) and the external thermal environment. 
Using the cumulants [2,], we can write as 



/oo r "° T/' 

exp —ik-x+ y — t(^^) 

\m\=l 



dk. 



(16) 



where k = {ki,k2, ■ ■ ■ , k2N) and k ■ x = J2i kiXi, and m = (mi, m2, . . . , rn2Ar) is multi-index; 
the cumulants K^ is given as 



Km{a,t) = {-i) 



\m\ 
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(17) 



k=0 



with multi-index / = {li,l2, ■ ■ ■ , hn) and the notation (x') = j p{x, t)x^dx. Thus, we write 
p(e, t) as a function of K^'- /5(e, t) = p(e. Km)- Because Km varies slowly as aj(t), we have 



Kmia + Aa,t + At) ^ Km{a, t) + ^T^^^^- 



(18) 



^ More precisely, e^ should be defined by x and tt, but macroscopically the value of ei[x,T:) for a state x 
comes from the time average for 7r(t) during At, and only the linearly increasing component a{t) in 7r(i) 
is effective, as 7r'(t) is a fast fluctuating time series. 

^ With the expression ([H)) and ([5]), the condition (|12ap can be rewritten as 



-/ / « ^ X N -/ / NX ■^-^ dp{e{x,a),t) dei , 

p{e{x, a + Aa),t + At)Ki p{e{x, a),t) + 2_^ '^ \' ^' ' ^Aa^ 



de. 



duj 



dp{e{x,a),t) 
dt 



At. 



(15) 



With multi-index n = (ni, 77,2, . . . , rz^), let us define Cn as 

p(x, t) = p(e, KJ = e^M=o "-'" , (19) 

i.e., 



Cnia,t) 



1 al"llnp(e,is:„ 



Then, considering ( 1T8|) . c„ varies slowly also as 



(20) 



J e=0 



dc 
Acn = Cn{a + Aa,t + At) - Cn{a, t) ^ -f^^t- (21) 

Finally we write />(e, t) as a function of c„: 

p(e(x, a), t) = p(e(x, a), c„). (22) 

III. EXPRESSION OF ENTROPY AND PROOF OF THE ENTROPY THEOREM 

Now, after time At from t, we have ensemble distribution p{e{x,a + Aa),Cn + Acn). 
Applying ([6]), ( fT2l) . ( !2T|) . and the normalization condition ( fT3l) . we have 



lnp(e(a;,a+Z\a),Cn,+Zic„) liip(e(a;,a),Cn,)N^ 

f ~f v~^ "9 In p ^ v;^ 9 In p dej . \ , 



=0, (23) 

where p = p(e, c^). Using ([H]) and J2j ^^^ Inp- (9^,6^ = X1h=i Cn^^^e", and noting that, since 
the averaged quantities 

(e") = f p{x,t)e''dx (24) 



^ c„Zi(6") - E E^"^^«^ - ^( E ^«<^")) = 0- (25) 



vary slowly as ([12]), we have (e")Z\c„ = Z\((e")c„) — c„Z\(e"), we obtain 

die"") 
dtti 

\n\=l \n\ = l i \n\=0 

Comparing with the approach for the quasi-equilibrium process given by Gibbs and Einstein 
pj, |2|, it can be understood that the first and second term respectively correspond to the 
terms describing the energy variation and the work performed on external system in the 
equilibrium thermodynamics, and the third term corresponds to the variation of the Gibbs 
entropy. 



Let us denote the third term in (125|) as 

oo „ 

S{t) = -Y^ Cn{€^) = - / p(x, t) In p{x, t)dx. (26) 

|n|=0 "^ 

Using the simphfied notation as J^ (it' j^ ^ dx' ■ ■ ■ = J^^ dt'dx' ■ ■ ■ ,^ and by the con- 
dition fll2p for the slow varying property of p{x,t), in zeroth order of At, we can write as 

4 

S{t) = - / rfx / dt'dx' p{x', t') \np{x', t') 

AtAI J J^,j. 

= -— / dt' / dxp(x, t') In ^^^ / dsdyp{y,s). (28) 

Here, from the Liouville's equation ([3]), p(?/, s) in the last integral can be expressed as 

= j dy'p{y'X)f[e-'^^''^^y^^^'^]6{y - y'). (29) 

Thus, finally we obtain 

S{t) = -^ y dt' j dxp{x, t') In j dy'piy', t') 

""aFatJ, dsdyf[e-'^^''^'^y'^^'^]6{y-y'). (30) 

And correspondingly the microdynamical expression for entropy, S should be given as 

Sit) = - J dxpix,t)\n J dx'p{x',t)^^ J dsdyf[e-'I^''^^y^^^'^]5iy-x'). (31) 

In above expression ( 13T|) . we have to note that, considering the error range —^<^o<^: 
the last integral term express the probability density PAt{x\x' ,t) to occur (in macroscopic 
realm) the event that the system initially positioned at x' in F a.t t is found at position x 
after time collapse ^, i.e., 

PAt{x\x',t) = ^^l dsdyf[e-'f^''^'^y'^^''^]6{y-x') (32) 



■^ As a special case of this notation, we will use /^ dx' = /^ dx' and /^ dt' = j^ dt'. 

^ In obtaining the second line of (1^ . we have used 



/ dxp{x, i) ■ ■ • = / dx-— / dx'p{x', t) ■ ■ ■ . (27) 



and it is the quantity describing the irreversible variation of the dynamical system initially 
positioned at x'.^ Because of the fast chaotic and ergodic motions generating the result ([7]) 
and OH]), PAt{x\x', t) is different from function, as the range of x over which PAt{x\x' , t) j^ 
cannot be covered by Ax, and the irreversibility contained in the Louville operator L{x, a, t) 
exactly corresponds to this irreversible functional variation from the initial distribution 
6{x — x'). As the initial position x' is changed, PAt{x\x' ,t) gives the complete information 
of the irreversibility of entire dynamics at t. In the following analysis, with the given above 
entropy expression, we will prove the entropy theorem for the completely isolated system. 

Let us consider the completely isolated system as ttj = const. Then pzit(x|x', t) is inde- 
pendent of t: 

PAt{x\x') = -^^ j dsdye-'^^^y^diy - x'). (34) 

For the fast chaotic and ergodic motions in the completely isolated system, we request that 
these complex motions make the following statement established: 

PAt{x\x') is a slow varying function for x and x' as p in the sense of (TT2l) . 

Then, by the above slow varying condition for pAt{x\x') and using 



e 



-iLiy>x(„ _ 



6{y-x) = e'^^''^'6{y-x), (35) 



we can write the followings: 

~A 



AtAr ./,,o 



PAtix\x') = ^^jjj, I dydse-''^^y>5{y-x') 
1 



, , dy'dydse-'^^y^'biy-y') 

A 

dydy'dse'^^y"^'5{y - y') 



AtAr jx,x',o 

1 ''^ 



AtAr ./x.x',0 



dydy'dse-'^'^y'^^'-^'^Siy-y') 



A 



dydy'dse-^'^^y'^-^'^^y^^'diy - y') 
AtAI Jx.x',0 



Ar 



I dye-^'^^y^^'pM{x'\y). (36) 

J X 



^ If we use the more precise definition (fTTj) for p, the expression (|32l) is replaced by 



/ d^od^f{^,^o)f e ''-4^ ' Six + ^~x'). (33) 

-oo J — c» 



On the other hand, from (fTOl) and (l29l) . p(x, f) can be written as 

p{x,t) = I dx p{x\t)pM{x\x'), (37) 



from which, using p(x',t — At) = e^^^^^'^^p^x' ,t) and the Hermitian property of operator 
L(x'), we obtain 

p{x, t- At)- p{x, t)= I dx'p{x', t)(e-^^(^')^* - l)pAt{x\x') (38) 

and similarly, using Liouville's equation (|3]), 

_P}^l!l= dx'p{x',t)iL{x')pAt{x\x'). (39) 

With ^-function 6{x) = 6{xi)6{x2) ■ ■ ■S{x2n), let us define the macroscopic (5-function S{x) 



as 



~^^^)^^j K^x-y)dy. (40) 

Then, substituting fl55]) and f l5I?]) to condition f lT^ . and replacing p{x',t) by 5(x' — y') with 
the notion that (155]) and (1551) hold for arbitrary p(a;', t), it follows that 



1 /-/^ ,■ /-^ 



dx'e-'^^^^'^^'pAtixW) ^ PAt{x\y') -At-—- dx'L{x')pAt{x\x'), (41) 



Arjy, ^...v^i-^.-^^.v-^,^. "^ ^^^^_ 



for the description of p(x, t) as conditioned by (IT2|) . Finally from (|36|) and the approximation 
(HTl) . we have the following result in macroscopic realm: 

PAt{x\x') =pAt{x'\x). (42) 

Also, since p{x, t) is expressed as in (157|) for the completely isolated system, integrating 
both sides of ( 157|) by ^ J^ (it' and using the relation given from the condition ( TT2l) 

1 f^ ,.,.. .. 1 '•'^ 



^ dt'p{x,t')^—J dt'[p{x,t)+dtp{x,t)-{t'-t)] 

^p{x,t + f) (43) 

and the formula (|27|) . we have 

p{x,t+ ^) = — / (it' / dx p{x' ,t')pAt{x\x) 

= / ^^' ^i^p / dt'dyp{y,t')pAt{x\y) 

= I dx' p{x' ,t)pAt{x\x), (44) 



because pAt{x\x') is a slow varying function for x and x' as p. And, with ( H^ and (fT2|) . we 
obtain the resuh 

g^ ^^ =XtJ dx'P^t{x\x') [p{x', t) - p{x, t)] , (45) 

where we have used J dx'pAt{x\x') = f dx'pAt{x'\x) = 1. 
Thus, from the definition ( l26l ) and (US 

dS{t) 2 



dt 



— —— dx dx'pAtix\x') [p{x',t) — p{x,t)][l + \np{x,t)] . (46) 



Exchanging x and z', we obtain a different expression of —^, and, adding these two ex- 
pressions and using ( H2|) . 

^ = -^J dx I dx'pAt{x\x') [p(x',t) -p(x,t)]ln0|. (47) 

Because pzif(a;|2;') given by fl34|) cannot be a (^-function in macroscopic realm as is defined 
in (j30|) . and the equilibrium state of the completely isolated system is identified as p{x, t) = 
const on an appropriate energy surface, we have 

dS{t) 



dt 



> 0, (48) 



if the system is in non-equilibrium state as p{x, t) ^ const on the energy surface; for the 
equilibrium state, —^ = 0. 

Consequently, as is manifested in comparison with the process of derivation of the Boltz- 
mann transport equation p, [QJ, the term pAtix\x') makes the role corresponding to the 
scattering matrix in the Boltzmann transport equation. Similarly as the scattering matrix 
in Boltzmann's theory describes the effect of the local intermolecular interaction given by 
physical potential (such as Coulomb potential), the term PAt{x\x') describes the effect of the 
fast chaotic and ergodic motions resulting (JTj) and ([9]). If we consider the systems initially 
positioned in the volume (x, x + Ax) in F, while these initial conditions are macroscopi- 
cally un-discriminable as the differences between them fall within the error range, the fast 
complex motions changes the each systems with the finely differentiated initial conditions 
to be respectively in completely different positions in F after time collapse At (or ^). And 
macroscopically this dynamical process related with the fast complex motions can be un- 
derstood as a y-body scattering-like process. To gain more physically intuitive picture for 
the calculation process of the entropy theorem, we rewrite entropy S given by ( l26l) . ( I30l) and 
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M|) as follows using the relation (jH]) in zerotli order of At: 

S{t) = -- dx dx'p{x,t)V^{x,x',t)p{x',t), (49) 



where 



V^{x,x',t) = pAt{x\x') 



\np{x,t) In p{x',t) 



(50) 



p{x,t) pix',t) 

If we interpret V^{x, x', t) as a potential interacting between two ensemble elements respec- 
tively positioned at x and x' in F at time t, the entropy theorem fHS]) simply means that 
the ensemble system always behaves to decrease the total potential energy induced by the 
ensemble potential V^{x,x' ,t). And, since pAt{x\x') ^ 6{x — x') by the fast chaotic and 
ergodic motions resulting ([7]) and (|9]), it means that generally the elements of the ensemble 
interact with each other through the potential V^ {x^x\t)] since we can expect from def- 
inition ( 1M1) that pz\t(x|x') and V'^ {x,x' ,t) have the tendency to decrease as the distance 
|x — x'l increases in /", we can say that the interaction by V^ {x, x' , t) is overall repulsive.^ In 
macroscopic observation realm, the fast chaotic and ergodic motions generating the results 
([7]) and dH]) emerges as a potential giving the interaction between the ensemble elements in 
phase space F] especially, if the ensemble system is equilibrium (p = const on an appropri- 
ate energy surface), the potential is given by V'^ {x,x' ,t) oc PAtiA^')- We use the notation 
(j)At{x,x',t) instead oi pAt{x\x',t) to emphasize the meaning oi pAt{x\x',t) as a ensemble 
potential originated from dynamic correlation, and the microscopic expression of entropy is 
written as 

S{t) = — / dxp{x,t)\n / dx'p{x\t)(pAtix,x',t), (51) 

where (j)At{x,x',t) = p^i{x\x',t) is given by the expression (!32|) . 

Finally, we point out that it is logically natural that the expression of entropy contains 
the parameter At which specifies the scale of the given measurement system, in that the 
entropy increment of a system is essentially related with the microdynamical components 
which cannot be described in deterministic way under the given measurement system: these 
fine dynamical information deterministically un-catchable by the given measurement system 
increase as the measuring scale At increases. Under the given measurement system, the 



^ On the contrary, in the original Gibbs entropy expression, it is treated as each ensemble ele- 
ments in r are completely independent of each other as the original expression is written as 



/ dxp{x,t) In J dx' p{x' ,t)S{x — x'), that is, pAt{x\x') — S{x — x'). 
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observer loses such fine dynamical information, and, only when there is the loss of the 
deterministic dynamical information by measurement imperfection, the entropy increment 
arises. For the perfect observer {At = and Ax = 0), the entropy expression becomes 
exactly the Gibbs entropy, i.e., S{t) = — J dxp{x, t) lnp{x, t), and thus there is no increment 
of entropy: ^ = as S" is dynamically invariant. 

IV. MEANING OF THE ENTROPY THEOREM IN PHASE SPACE DYNAMICS 

From the Liouville's equation (|3]), we can obtain the description for the macroscopic 
ensemble distribution p{x,t) in F. Integrating both sides of the Liouville's equation ([3]) by 
J^^ dt'dx' and noting the expression fl2^ . we have the results as 

^-^ = -Y.irf'(-^')iA-,t), (52) 

i 

where, for the completely isolated system, Vi{x,t) is given as 



with the definition 



Vi{xA) = -- — -— - / dt'dx' Xi(x')p(x',t') 

'"• ' p{x,t)AtAr J,^, '^ ^^^ ^ 

dx'v°ix,x')^^^ (53) 

p{x,t) 

v-{x, x') ^ -^^ I dsdyx,{y)e-''^^y>6{y - x'), (54) 

where x{x) = {xi{x) , X2{x) , . . . ,X2n{x)) = {q{x),p{x)) denotes the velocity field in F given 
by the Hamilton's equations of motion for J^{x), i.e., 

x{x) = {dp,J^, ...,dp^je, -dq,J^, ..., -dq^M')] (55) 

if we integrate both sides of f lS5]) by j^ dt' and note that v° and Vi is a slow varying function 
as p{x,t), then, with the formula f l27|) and similar process as in (B3|) and (jSj), in zeroth 
order of At, (153!) can be rewritten as ^ 

di{x,t)= [ dx'v°{x,x')^^f-^. (56) 

J pyx, t) 



^ As is indicated by the expression ([56]) . AT ■ v°{y,y) is the velocity field (at position y in F) observed for 
the ensemble of the systems which are prepared to be in state y under the macroscopic measurement, i.e., 
p{x) — 5{x — y). And, for the ensemble system prepared as p{x) = \5{x — y) + \5{x ~ y'), AT ■ v°{y, y') 
is the contribution to the velocity field at y by the ensemble elements positioned at y' . 

12 



That is, Vi{x,t) is the velocity field (in F) observed in macroscopic point of view, and the 
averaged macroscopic motion in F is given as 

—^ = v,{x,t). (57) 

Then, by the definition of entropy fl2^ and flS2]) . we have 

dS{t) f ^^-^dvi{x,t) 



p{x,t)J2^^^^dx. (58) 



dt J ^-^ dx 

Thus, 0481) means that, for the completely isolated system, the macroscopically observed 
motion of the ensemble in F is not incompressible any more: generally, 

dvi{x,t) 



Y.-^^^». (59) 



dx 

and, in macroscopic realm, the local volume in F averagely expands, if the system is in non- 
equilibrium state (p 7^ const on an energy surface). Finally, if we treat the combined system 
of J^ and its environment system as a closed (i.e., completely isolated) Hamiltonian system, 
the entropy theorem can be restated as averagely the local volume in the total phase space 
always expands, if the total system is in non- equilibrium state as the ensemble distribution 
is not constant on an appropriate energy surface. 

V. THERMODYNAMIC RELATION 

Reminding the assumption that we can macroscopically control the statistical properties 
of ej in flT^ . let us consider the process where a{t) and the external thermal environment 
are given as they induce only the change of energy value E = H{x) + Mnt(Q') cl) of the system 
([T]): for p{E, 62, 63, . . . , t), we consider the variation of E only as e^ = const. Then, the result 
corresponding to (123]) is simply obtained by replacing e in (I25p with E: 

00 ^ 00 -. 

AS = Y: ^^E^"-^ + E ^ E ^/"^^«- (60) 

n=l n=l I 

where we have used the notations as -E^"-* = (i?"), T„ = — — , and 

,«._^. " (a. 

In non-equilibrium process, we have (160!) as a relation directly corresponding to the thermo- 
dynamic relation in the equilibrium thermodynamics. 
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The formulation (160|) means that, in general non-equilibrium thermodynamic process, 
in addition to the average energy E^^\ we should treat the each statistical properties 
^(") = (-E") of E as independent macroscopic thermodynamic variables. Also, to describe 
the mechanical interaction with the external environment, we should treat the new E^"'^- 
corresponding forces F^ defined by (161 p in addition to the conventional force F/ = — q^- 
In this case, the thermal characteristic of the system is completely determined by the quan- 
tities T„, which is given by the relation fl60|) as 



where n = 1,2, .. . (Ti is the temperature in the equilibrium thermodynamics). Keeping 
the conventional understanding of temperature as a quantity to describe the thermal char- 
acteristic of a system in relation with it's entropy and energy variation, fl^U]) means that, in 
general non-equilibrium process, the thermal characteristic of a system is specified by many 
temperatures T„. That is, generally the temperature of a non-equilibrium thermodynamic 
system should be defined not by a single scalar quantity but by an array of temperatures 

T = (ri,T2,...,r„,...), (63) 

where the each component r„ is the measure of how the entropy S increases as the statistical 
property (F") increases. 

Let S be the space defined by the ordered-tuple (T,a). Since the ensemble distribution 
p{x, t) at an instant is completely determined by the ordered-tuple (T, a), arbitrary thermo- 
dynamic process for a given system can be described as a path in the space Z". If a system 
interacting with a thermal reservoir transforms from equilibrium state (Ti, a) to equilibrium 
state {T[,a'),^ the entropy increment of the system during the process is path-independent 
in the space E, because entropy S defined by f l26|) is a function of (T, a) as (e") is a function 
of (T, a); if R and / respectively represents a reversible and irreversible path connecting 
state (Ti, a) to state {T^, a') in S, the entropy increment for the reversible path Jj^dS is the 
same as that for the irreversible path Jj dS. Thus, by ( I6OII . we have 



The notation (Ti, a) is the abbreviation for the case that ^ = for n > 2 in (T, t 
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where 

(iQ^") = dE^""^ + J2 Ft^da,. (65) 

i 

Let the thermal reservoir be quasi-ideal in the sense that the ensemble PDF of the closed 
total system (containing the thermal reservoir) is always given by the form 

Ptot = e'="-T-^-iir, (66) 

where S and T are respectively the energy and (conventional equilibrium) temperature of 
the reservoir: the reservoir always varies through quasi-equilibrium process. In such case, 
for all irreversible process where dQ^^^ = 0, the entropy variation of the closed total system 
is given as 

^^tot = f:/^>0, (67) 

where the inequality comes from fj^Sl) . Thus, we expect X]^2 // t — > in flM|l . and obtain 
the classical relation 

^>/^ (68) 

for the case that the thermal reservoir is quasi-ideal as is described in (166!) . 



VI. DERIVATION OF FLUCTUATION THEOREM 

In the foUowings, to guarantee the precise microscopic dynamical time reversibility, we 
treat the combined system of the dynamical system H in (^^ and its external environment 
system as a completely isolated Hamiltonian dynamical system, and write Hamiltonian J^ 
as 

J^{x) = H + Vi^, + H,^„ (69) 

where Hext denotes the Hamiltonian of the external environment and Vint is the interaction 
potential between the system H and iJcxt as previously introduced. The phase space F 
represents the total phase space defined by the canonical variables of H and iiText, and 
X = {qi, . . . ,q]y,pi, . . . ,piy) represent a point in this total phase space F. 

Then, for the completely isolated system J^{x), the macroscopically observed dynamics 
in F is given by the equations of motion flFTI) with the velocity field expressed as (jSSD; 
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as previously argued, generally this velocity field is not incompressible. By the continuity 
equation fl52l) and fl57|) . we obtain 

^^ = -Pix,t)Y:^^ff\ (70) 

i 

Let us consider an arbitrary trajectory x{t') satisfying the equation of motion (157|) : let x{t') 
satisfy x{to) = xq and x{t) = x. For the trajectory x{t'), from ( ITOj) . we have 

p(x,t) = p(xo,to)e ^*o^' a^. '='*, (71) 

where g^ ^ = q^. ■ In above equation, from the expression (1581) for ^, we can interpret 
the quantity Yli a' ^s the entropy increment rate for a state x at t, and 



represents the entropy increment for the trajectory x{t') during the time interval [to,t]. 
For x{t') = {q{t') , p{t')) , let us define 

x*{t')^iq{t'),-pit')). (73) 

Then, the time-reversed time series of x{t') is given as 

x^{t')=x*{t + to-t'). (74) 

During the time interval [to,t], the probability density to observe the time series x{t') is 

p{x{t'); [to, t]) = p(xo, to). (75) 



On the other hand, if the equations of motion ( [57| ) allows the time-reversed solution of the 
solution x{t') during [to, t], i.e., if x^{t') can be a solution of (!57|) during [to, t], the probability 
density to observe the time-reversed series x\t') during [to,t] is 

p(xt(t');[to,t])=p(x*(t),to). (76) 



Thus, using (171]) and fl72|) . we have 



p(xt(tO;[to,t]) ^ p(x*(t),to) ^_,, 

p(x(t');[to,t]) p(x(t),t) "" ■ ^ '' 
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Especially, if x{t') starts and ends in a same stationary state as p{y,tQ) = p{y,t) = p{y), 

p{x{t')-[t,,t]) p{x) ' ^ ^ 

where generally the stationary state p{y) can be different from the equilibrium sate expressed 
by p{y) = const on an energy surface.^ 

In obtaining the results ( 1771) and (1781) . we have assumed that the equations of motion 
( 157|) allows the time- reversed solution x^{t') for an arbitrary given solution x{t'). However, 
as can be inferred from the expression f l56|) for Vi{x,t), although the microscopic dynamics 
is always time-reversible, the macroscopic averaged dynamics (1571) is generally not time- 
reversible. In the foUowings, we formulate the condition for the ensemble to guarantee the 
time- reversibility of the dynamics ( 1571) for a given time interval [to,t]; then the condition 
will gives the final form of the fluctuation theorem. 

In order that the dynamics fl57|) is time- reversible during the time interval [tQ,t], the 
equations of motion should be invariant under the transformation 

{x,t')^{x*,t + to-t'). (79) 

Replacing {x,t') with (x*,t + tg — t') in (1571) and using (156|) . we obtain 

— — = - / dxv^{x ,3:) ^,^^ , , ^ 77Y' (80) 

where, from (154|) . 



dt' J '' ' 'p(x*,t + to-t') 



v1{x\x') 



AtAr ./o,. 



.A 

/ dsdyx^iy)e-'^^y>5iy-x'). (81) 

Jo,x* 



In above expression, using L{y*) = —L{y) and (jSSD, and noting that v°{x, x') a slow varying 



^ For example, if the external environment system is constituted by two ideal thermal reservoirs with 
different temperatures with each other, where the 'ideal' means that they have infinite energy capacity, 
then the time length necessary to equilibrate the system Jif(x) becomes infinite, and p{y) will be a 
non-equilibrium stationary state. 
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function for x and x' as p in the sense of (fT2|) ^'^j we can write 



v1{x*,x') = -j^j^ j ^ dydsx,{y)e-^'^^y>6{y - x') 

1 r^ 

dy'dydsxi{y*)e~''^^y'^'d{y* - y') 



AtAr^ 



x'xfi 



1 ''^ 



^^^^2 I dy'dydsx^iyne-'^^^y^^-'^'^diy-y'*' 



x',x,0 
A 



1 

lx'x,0 



AtAr' J , dy'dydsx,{y*)e-^'^^y>-^'^^y"^^'5{y - y' 



= ^\yy'^~^'^^'"^'''^T^^.v'*) (82) 

with the definition 

C(^, ^') = ^^ I rfsrfyx,(y*)e-^(^)^5(2/ - x'). (83) 

Let us consider the velocity field obtained by replacing v°{x^ x') in expression fl53|) with 
'?)°*(x, x'), i.e., 

v*{x,t) ^ I dx'vr{x,x'*)^^^. (84) 

Since v*{x,t) is different from Vi{x,t) just in the sign of its components corresponding to 
i < N, the velocity field v*{x,t) is also slow varying function for t as Vi{x,t) and p{x,t). 
Thus, if we define //j(x, t) = p{x, t)v*{x, t), pi{x, t) varies slowly as 

Pi{x,t + At)^Pi{x,t)+ ^'^J^^^^ At. (85) 

Then, as the same as the process of obtaining fl38|) and fl39l) . with the expression of pi given 
by (1M|) and Hermitian property of the operator L(x, a), we have 

..(M-4«)^/<;.x'p(.».<)e-'-'-.r(...'-) (86) 

and 

^M^= fdx'p{x'*,t)iL{x'*)vr{x,x'*). (87) 

Using fl86l) and fl87|) . the condition (l85l) is written as 

(ia;'p(2;'*,t)e-'^("'*)^*t}r(x,x'*) ^ [ dx'p{x'*,t) [1 - iL{x'*)At]vr{x,x'*). (88) 



^° In obtaining the second line in ((82|) . we have used /^_^ ~ /^ ^ foi' ^^ = (^9; ^-P) ^'^ ^"(^^j^;') is a 
slow varying function for x. 
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And, with the substitution p{x'*,t) = 5{x' — y), we have the approximation 



dx'e-'^^''"^^'v1*{x, x'*) ^ vT{x, y*)-At--— / dx'L{x'*)vrix, x'*), (89) 



Jy -Jy 

which is sufficient for the description of the slow variation of p(x, t) as conditioned by (iT2l) . 
Then, applying (1891) to (!82|) . the expression of v°{x* ,x') in macroscopic realm can be written 

as v1{x*,x') = v°*{x,x'*), i.e., 

vn^%x') = -^^ j dsdyx,{y*)e-^'^^y>5{y - x'*)- (90) 

Thus, substituting fl90|) to f lHOj) and considering that x{y*) = {—q{y),p{y)) for x{y) = 
{q{y),p{y)) and the definition (IMI) . the transformed equations of motion (IHO!) is identical 
with 



dxi{t') [ , ,~oi >*.pix',t + to-t') 
— ' dx v"{x,x ) — 



dt' J '' p{x*,t + to-t') 

dx'v°{x,x Y^f*'^^^''~^'} . (91) 

'^ ' p{x*,t + to-t') ^ ' 



On the other hand, by (1561) and ( 1571) . we have 



dxi(t') f , . „, ..pix't') .. 

^ ^ - ' dx't;°(x,xO , , . (92) 



dt' J *' ' p(x,f) 

From the condition that (19T|) should coincide with ( 192|) for arbitrary v°{x,x'), we obtain 



p(x',t') p{x,t') 

the time-reversibility of the macroscopic dynamics (1571) is written as 



Pi^^ — — j _ pi^j — — j^ which holds for arbitrary points x and x'; thus, the condition for 

Lcroscopic dynai 

*:^±|P^^C,.;Mo), (93) 

where C{t';t,tQ) is independent of x and a function of t' only, containing the parameter t 
and to- Especially, in case of stationary state, the condition f l93|) is written as 

P^ = C = const. (94) 

p{x) 

Also, if we substitute t' = t in (p3l) . we obtain 

4^ = C(t,to)=const, (95) 

where the last equality C(t,to) = const means that C{t,to) is a fixed constant value for a 
given time interval [to,^]- 
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Finally, using the above conditions dH]) and (p5|) . the fluctuation theorem [3| follows from 
dZZD and(I78D 

p{x{n[to,t]) ^' • ^^^^ 

Thus, we have the conclusion that, for an arbitrary closed Hamiltonian dynamical system 
with chaotic and ergodic properties, if a trajectory x(t) is observed in macroscopic measure- 
ment for arbitrary (equilibrium or non-equilibrium) thermodynamic process and there exists 
non-zero probability to observe its time-reversed trajectory x^(t) in the same process, the 
fluctuation theorem (jHS]) always hold. 

VII. CONCLUDING REMARKS 

In this paper, we have constructed the generalized nonequilibrium extension of the en- 
tropy theory given by Gibbs and Einstein [l|, |2|. Also, based on the generalized entropy 
theory, we have derived the fluctuation theorem. The entropy increment is directly con- 
nected with the presupposition (as is represented by ([7]) and ([9])) that there are fast chaotic 
and ergodic motions which cannot be described in deterministic way under the given macro- 
scopic measurement system. In macroscopic observation, such fast complex motions behaves 
as an ensemble potential in phase space (giving the interaction between ensemble elements), 
and resultantly, the phase space volume is not conserved. The entropy increment arises 
only for the imperfect observer who experiences the loss of the deterministic dynamical in- 
formation by measurement imperfection. In this respect, the emergence of the irreversible 
physical time is an intrinsic phenomena to occur only for the imperfect observer by that the 
observer constantly loses physical informations. 
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